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UNDERGRADUATE ASSESSMENT EFFORTS IN 
ARIZONA'S UNIVERSITIES: A STATUS REPORT TO 
THE TASK FORCE ON EXCELLENCE, EFFICIENCY 
AND COMPETITIVENESS 



PETER T. EWELL 



In March, 1988, the Task Force on 
Excellence, Efficiency, and Competitive- 
ness (EEC) of the Arizona Board of 
Regents contracted with the National 
Center for Higher Education Manage- 
ment Systems (NCHEMS) to visit Ari- 
zona's three four-year public universities, 
and observe the status of institutional 
efforts to assess the quality of undet- 
graduate education. This report docu- 
nents the results of these visits. There 
were several reasons for the Task 
Force's interest in this topic. First, institu- 
tions had been requested by the Board 
to prepare multidimensional assessment 
plans as part of an overall "Plan for Im- 
proving Undergraduate Education" for 
1987-88; institutional plans must be 
submitted to the Board by May 1, 1988. 
More importantly, the Task Force was 
interested in exploring a range of mecha- 
nisms designed to improve the effective- 
ness of undergraduate education, and 
assessment has been r luch discussed 
as a potential lever for improvement. 

Both reasons suggested that the Task 
Force take a serious look at the status of 
undergraduate assessment at the insti- 
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tutional level to determine both the prog- 
nosis for assessment initiatives currently 
under way, and to determine if assess- 
ment constituted a viable, cost- effective 
means to improve undergraduate in- 
struction. 

NCHEMS consultants visited the three 
campuses during two weeks in March of 
1988. Two days each were spent at the 
University of Arizona (UA) and Arizona 
State University (ASU), and one day was 
spent at Northern Arizona University 
(NAU). In advance of the visit, consul- 
tants conferred with institutional repre- 
sentatives by telephone, and reviev/ed a 
range of documents provided by the 
institutions-including drafts of the as- 
sessment plans being prepared for sub- 
mission to the Board. Other documents 
reviewed prior to or during the visits 
included curriculum plans, placement 
tests, existing and proposed student 
surveys, course evaluation forms, and 
procedures for departmental or program 
review. During the visits, interviews were 
conducted with a variety of individuals. 
Minimally, however, they included ses- 
sions with the faculty/administrative 
committee charged with planning the 
assesr^ment effort, with those respon- 
sible for institutional data collection such 
as institutional or student affairs research 
personnel, with a sample of Deans, and 
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with academic affairs staff (See Appendix 
A for an interview schedule for each 
campus visit). Each visit also included a 
session with a top administrator-either 
the President or Chief Academic Officer. 

Visits were intended not only to gather 
but also to give information. As a result, 
NCHEMS staff approached these visits 
as they would a standard consulting 
assignment: a primary responsibility was 
to provide advice to eadi campus about 
how their efforts might be improved. 
Consistent with this philosophy, 
NCHEMS provided each campus with a 
consulting report presenting a range of 
observations about their efforts and 
some suggestions for further direction. 
As per agreement with the Task Force, 
these reports were sent directly to the 
campuses and were intended solely for 
their use in implementing a better pro- 
gram. We believe that this feature of the 
visits directly benefited the campuses 
and also helped ensure the overall suc- 
cess of the project in gathering accurate 
information about the status of campus 
plans. 

The bulk of this report will present our 
observations about the status of assess- 
ment activities at the campus level. Rath- 
er than reporting on each institution 
separately, we will discuss their individual 
situations in terms of a set of generic 
headings that attempt to describe the 
status of assessment efforts statewide. 
Given these obsen/ations, we will con- 
clude the report with a brief set of policy 
recommendations for further considera- 
tion by the Task Fci-ce. 



OBSERVATIONS 

We present our observations in this 
section on the basis of four major dimen- 
sions. The first. Administrative Support - 
Leadership and Commitment will ad- 
dress the overall administrative climate 
for the effort at each of the three cam- 
puses. Discussion will consider the gen- 
eral attitude of top leadership toward 
assessment and their perceived willing- 
ness to back it up with appropriate re- 
sources and organizational support. A 
second section. Information Resources 
and Infrastructure will address the extent 
and adequacy of management informa- 
tion at each institution~a critical founda- 
tion upon which any assessment pro- 
gram must rest. A third. Organization of 
Assessment will explicitly discuss the 
scope and structure of institutional as- 
sessment plans, including a general 
review of the strengths and weaknesses 
of each. A fourth section. Implementation 
Status and Prognosis will address the 
degree to which these plans have been 
fulfilled to date, including committee 
structures, organizational development, 
and actual data collection, and will indi- 
cate how we expect these plans to pro- 
gress in the coming year. 

0 Administrative Support, Leadership, 
and Commitment: 

Common sense and past experience 
alike indicate the importance of top ad- 
ministrative support for an initiative such 
as assessment. Not only does such an 
initiative need sufficient resources to be 
successful, but it also implies a substan- 
tial change in institutional culture. In 
essence, successful assessment de- 
pends upon the institution being willing 
to act on concrete information to ad- 
dress deficiencies. In addition to provid- 
ing the necessary resources to accom- 
plish required data collection, this implies 
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that top leadership be both "information 
conscious" and be able to demonstrably 
link decisions taken to a concrete body 
of evidence. Lacking thGse ingredients 
of support, comprehensive institutional 
assessment efforts are rarely successful. 

In general, the situation at the three 
Arizona four-year campuses is adequate 
on this dimension. Despite the fact that 
the stimulus for assessment is exter- 
nal~a Board of Regents mandate for 
action-academic leadership at all three 
institutions understands that it is possible 
to proceed in a fashion consistent with 
institutional mission. None of the institu- 
tions is developing plans in a "cookbook" 
fashion by attempting to use a "recipe" 
borrowed from another institutinn-a 
phenomenon which we have often ob- 
served in other states where assessment 
plans have been mandated. Moreover, 
institutional leaders seem to have sub- 
stantially grasped the fact that institution- 
al initiative with respect to assessment 
may enable them to address some im- 
portant local problems concerning the 
integration and improvement of the un- 
dergraduate curriculum. 

Within this overall picture, however, 
patterns of support differ among institu- 
tions. UA currently enjoys the advantage 
of a head start in assessment planning 
and consequent administrative familiarity 
with the issue. At the same time, a range 
of UA undergraduate initiatives currently 
under way, and funded through several 
Decision Packages in the past two years 
has generated considerable momentum 
in the area of undergraduate education: 
undergraduate education is consequent- 
ly comparatively high on the agendas of 
UA's academic leadership. Moreover, 
ihe UA Provost is "information con- 
scious" and is demonstrably interested in 
obtaining information on the effective- 
ness of instructional programs-both for 



internal planning purposes and for com- 
munication to interested parties outside 
the university. Consequently, he seems 
willing to invest real resources in the 
effort~a willingness demonstrated by the 
establishment of a staffed Center for 
Research on Undergraduate Education 
(CRUE) charged with the assessment 
mission. In such a climate, our only 
concern is a need to set priorities and to 
keep expectations within bounds. The 
success of CRUE at UA depends upon 
its ability to sustain a body of long-term 
•"esearch on undergraduate effective- 
ness-a fact that the Provost under- 
stands and supports. Important in the 
coming years, however, will be to guard 
against temptations to deploy CRUE's 
limited resources toward short-term data 
gathering efforts designed only to ad- 
dress immediate problems. 

Because ASU is currently recruiting a 
chief academic officer, its position with 
regard to top administrative support for 
assessment is more uncertain. Indeed, 
assessment planning has been some- 
what encumbered by reluctance to make 
key staffing, organizational, and funding 
decisions until a new chief academic 
officer is on board. This condition is 
reflected in ASU's working plan for as- 
sessment to be implemented next year, 
which contains no explicit budget or 
timelines for carrying out proposed ac- 
tivities. At the same time, there appears 
to be willingness to support implementa- 
tion of the effort on the part of mid-level 
academic leadership-in particular Deans 
in some of the key colleges and schools. 
Evidence of past willingness to act on 
evaluation information is provided by 
ASU's evolving program review pro- 
cess-a process founded on the Board 
of Regents' mandated decennial review 
process for all academic programs. 
While the implementation of program 
review is not uniform across units at 
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ASU, several schools and colleges have 
both taken the process seriously and 
have addoJ a numiser of local enhance- 
ments to the basic Board requirements. 
Until the overall leadership situation in 
academic afteirs is clarified, however, 
ASU's implementation of assessment will 
also be uncertain. 

For NAU, a major advantage is the per- 
ceived clarity of the institution's mission. 
The fact that NAU has chosen to stress 
undergraduate instruction in itself speaks 
favorably for the institution's collective 
willingness to embark upon a meaningful 
assessment program. Interviews with the 
President and top academic leadership 
support this overall perception: all begin 
yvith the premise that undergraduate 
instruction is what the institution is pri- 
marily aboiA and that assessment repre- 
sents an excellent vehicle for improve- 
ment. Moreover, the mariner in which 
NAU has chosen to respono to requests 
of the EEC Task Force for information 
on a variety of aspects of undergraduate 
education also provides evidence of 
broad understanding. Rather than de- 
velop separate reports for "assessment", 
"advlsemenr, and "involvement", the 
institution charged a single committee to 
address all three~an action that appro- 
priately stresses the integrated nature of 
the issue. Rnally, NAU has a demon- 
strated history of using obtained informa- 
tion for decisionmaking through its pro- 
gram review process. The coverage, 
structure, and timelines for this process 
go well beyond the Regents' guidelines 
for decennial reviews, and there is sub- 
stantial evidence of past use of review 
results to accomplish actual dollar real- 
locations among programs. 

Because of the critical nature of top 
administrative support, we believe that 
the Board should carefully monitor its 
condition at each of the institutions in the 



coming years. Important institutional 
indicators of support will include the 
degree to which identifiable dollar re- 
sources are devoted to the effort, and 
the degree to which requests to the 
Board (and to others) for funds to sup- 
port new programs or program improve- 
ments are grounded in appropriate evi- 
dence about past and anticipated in- 
structional outcomes. 

0 Institutional assessment programs: 

Successful institutional assessment pro- 
grams almost never start from scratch. 
Most rely on a careful blend of existing 
data resources, judiciously supple- 
mented by a small number of well-de- 
signed adaitional studies or examina- 
tions. Even if a large number of new data 
collection initiatives are contemplated, 
these too depend upon the existence of 
a well-conceived structure for institutional 
man&gement information. Almost all 
successful undergraduate impact stud- 
ies, for example, will rely upon the in- 
tegrity of the student record system and 
upon the ease with which information 
from that system can be identified, ex- 
tracted, and manipulated. Most will also 
rely heavily on existing "points of con- 
tact" with students where data are al- 
ready collected-such as orientation, 
registration, placement testing, course 
evaluation, and existing comprehensive 
examinations and surveys. As a result, 
the current condition of management 
information at any institution, with regard 
to both its scope and integration, con- 
stitutes an important factor in determin- 
ing the probability of success of a pro- 
posed assessment effort. 

With regard to basic information infra- 
structure, we found that the three institu- 
tions differed considerably. In the best 
position is probably ASU, where existing 
data and analytic resources are in good 
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shape. The existence of an Office of 
Institutional Analysis charged with broad 
research lesponsibllities means that 
access to student and other archival 
databases is conriparatively straightfor- 
ward. Integrity of the basic student re- 
cord system upon which most outcomes 
analysis must rest is good, and the con- 
struction and maintenance of longitudinal 
research files drawn from multiple data 
sources appears routine. Similarly, a 
research program in Student Affairs, 
though limited in scope, undertal<es a 
series of well-constructed student sur- 
veys and other relevant studies. Not only 
do such studies yield information in their 
own right, but they also constitute an 
opportunity for addressing some broader 
research questions about levels of stu- 
dent involvement and quality of effort. 
One area needing attention, however, is 
information about graduates and former 
students. 

A second advantage enjoyed by ASU is 
the fact that many of the university's 
programs are independently accredited, 
and must consequently undergo a pro- 
cess of external review that often in- 
cludes assessment of student learning. 
To a lesser extent, this characteristic is 
shared by the other two campuses as 
well. As a result, there are already some 
local programmatic models available for 
conducting such activities as follow-up 
studies of recent graduates and their 
employers, or for assessing student 
skills development in practical settings. 
Many of these programs also require 
certification testing. Moreover, ASU's 
new General Studies cuniculum provides 
an excellent structure for evaluation. Not 
only are the goals of the curriculum well 
specified, but a proposed periodic review 
process for all General Studies courses 
also constitutes an opportunity to under- 
tal<e a range of data collection efforts 
aimed at determining overall curriculum 



impact. In addition, widespread discus- 
sion of this curriculum and its goals have 
already to some extent raised faculty 
consciousness about the nature and 
structure of undergraduate education at 
ASU. 

At UA, we find basic information resour- 
ces to be present and sound, but disor- 
ganized. The existence and activities of 
a Student Affairs Research, Evaluation, 
and Testing Center is a major asset for 
an institution of UA's size and type, and 
the l<inds of studies undertal<en by this 
office (for example an ongoing longi- 
tudinal student tracking database and 
several comprehensive student survey 
efforts) constitute a major resource for 
an integrated student assessment pro- 
gram. Furthermore, programs such as 
UA's Upper-Level Writing Proficiency 
Examination (ULPWE) are both commen- 
dable and very unusual at a major re- 
search university. Not only does this 
examination yield outcomes data in its 
own right, but it also provides an excel- 
lent "mid-point" curricular setting for 
collecting additional assessment informa- 
tion fi'om students. Balancing these 
assets, the articulation among various 
data collection and analysis "pockets" at 
UA is loose to nonexistent. This situation 
is being addressed, in part, by the es- 
tablishment of the Center for Research 
on Undergraduate Education (CRUE), 
but this office is both new and is not 
intended to provide a clearinghouse for 
all management information. Between 
them, however, CRUE and the Student 
Affairs research office should provide a 
good informational foundation for as- 
sessment: the Center will continue to do 
large-scale student flow or behavioral 
studies using student records and will 
continue to do most survey research, 
passing on results to CRUE as needed; 
CrIUE itself will have primary respon- 
sibility for assessing cognitive outcomes 



623 

6 



and for conducting studies on the impact 
of curriculum. 

TTie situation with regard to basic infor- 
mational capacity at NAU is less favor- 
able. For an institution of its size and 
type, we find NAU seriously underin- 
vested with regard to management infor- 
mation-particulariy information about 
students. Currently the university main- 
tains no regular student survey or alumni 
follow-up efforts, and only limited lon- 
gitudinal tracking databases-data re- 
sources that are not uncommon at in- 
stitutions of half its size. To seriously 
undertake a student assessment pro- 
gram.mjyor deficiencies in "data infra- 
structure" will need to be addressed~a 
situation recognized and reflected in the 
current draft plan for assessment. 

At the same time. NAU possesses some 
structural assets for efficient collecting 
additional information on student out- 
comes. Rrst, effective local development 
of the program review process provides 
a foundation for extending assessment. 
Modifying cun-ent program review guide- 
lines to require additional data on pro- 
grammatic effectiveness, as contem- 
plated by the university's plan, will largely 
answer the need to collect assessment 
infomiation at the departmental level.Se- 
condly. recent changes in many under- 
graduate major programs at NAU to 
include a "capstone" course place the 
university in a good position to under- 
take additional assessment. Because 
such courses are themselves intended to 
be integrative, student performance in 
them can be treated as evidence for the 
attainment of identified curricular goals. 
Moreover, the "setting" provided by 
capstone courses is a natural one for 
"embedding" program-specific assess- 
ment activities such as major field com- 
prehensive examinations, integrative 
projects, or portfolios of student work. 



The Task Force should recognize the 
fact that the efficiency and effectiveness 
with which assessment can be imple- 
mented depends to a great extent on the 
presence and organization of existing 
management information. Insofar as 
these are consistent with other concerns 
of the Task Force, we would support any 
recommendations contemplated to in- 
tegrate and strengthen the information 
function at each of the three universities. 

o Organization of Assessment: 

Experience at other institutions has 
shown that successful assessment re- 
quires careful planning and adequate 
time to develop. It also requires a con- 
sciously organized effort-including clear 
assignment of responsibility for the ac- 
tivity, adequate support, and an ongoing 
research program founded upon mutual- 
ly supporting data collection efforts. A 
primary function of institutional assess- 
ment plans-in place at UA and under 
development for submission by May 1, 
1988 at ASU and NAU- is to outline 
exactly how the institution intends to 
meet these requirements. Consequently, 
we devoted con-siderable attention to an 
examination and critique of the three 
assessment plans. 

At UA, the groundwork for a comprehen- 
sive student assessment effort has been 
extremely well laid in a Task Force Re- 
port produced by the university last year. 
Compared to others of its type national- 
ly, this Report is unusually cogent and 
well-written. It recognizes that compre- 
hensive assessment is a complex, multi- 
faceted enterprise that will take time and 
organization to implement successfully. 
It also recognizes and addresses two 
important attributes of assessment work 
that are often overlooked: the fact that 
studies of curricular impact must be 
longitudinal in order to document change 
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as students progress, and the fact that 
studies must equally embrace data col- 
lection atxDut Inputs, processes, environ- 
ments, and outcomes In order to provide 
an Informed basis for Intervention. The 
centerpiece of the report Is establish- 
ment of a Center for Research on Under- 
graduate Education (CRUE), reporting to 
an Associate Vice-President for Under- 
graduate Education, and charged with 

(a) carrying out ' limited number of 
ongoing longitudinal studies, 

Co) documenting, coordinating, and 
disseminating the results of additional 
assessment-related studies and bod- 
ies of Infomiatlon held by others, and 

(c) working with individualdepartments 
(several each year) to develop local 
program-spedficassessment instru- 
ments and procedures. 

Staffing and budget requirements for 
CRUE are fully outlined In the Report, as 
are the explicit types of studies that 
CRUE will undertake. At the same time, 
we note that the Report and Its contents 
have not been widely discussed at UA, 
and that xident assessment remains a 
relatively unknown activity among faculty 
and line administrators. We suspect that 
this will change when the process actual 
data collection begins. 

Planning at the other two campuses Is at 
an earlier stage of development, as 
assessment plans are to be submitted in 
May. In essence, both are "plans to 
plan"~proposlng a process for next year 
that emphasizes pilot data collection on 
a wide range of Instruments and estab- 
lishment of a coordination function, with 
a final decision about ongoing organiza- 
tion and procedures to be made at the 
end of the year. Neither plan explicitly 
establishes a "center" on the UA model. 



though needs for additional staff to coor- 
dinate the effort and to provide technical 
exr ertise are addressed by both. Both 
plans also outline an organlzatbnal nex- 
us for the effort. At ASU, this Is provided 
by the office of the Vice-President for 
Academic Affairs, with appropriate link- 
ages to Deans through such processes 
as program review. At NAU, the prob- 
able organizational setting for the as- 
sessment function will also be academic 
affairs, but draft plans also establish 
formal linkages between assessment 
activities and established faculty commit- 
tees such as Liberal Studies and the 
Curriculum Committee. 

Emerging plans at ASU and NAU also 
address the kinds of instruments and 
procedures to be used in assessment. 
Under consideration at .*SU is adminis- 
tration of the ETS "Academic Proflle""a 
standardized instrument for assessing 
the outcomes of general education, the 
coverage of which appears congruent 
with the goals of the university's General 
Studies program-as well as several local 
options. Moreover, like UA, both ASU 
and NAU intend to undertake a limited 
number (six or seven) of "pilot projects" 
in assessment at the departmental level. 
These will be fielded both to provide 
institutional experience in using assess- 
ment results and to explore some par- 
ticular data collection techniques. At both 
Institutions, a summary "model" attempts 
to describe what kinds of data collection 
options are under consideration for what 
purposes at what points in the curricu- 
lum. At ASU this is embodied in a se- 
quence of phases for prog -am develop- 
ment. At NAU it Is shown as a "timeline" 
documenting proposed data collection 
options and points. 

The Trisk Force should be aware that 
considerable changes in these plans 
may occur as the institutions gain ex- 
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perience with what works and what 
doesn't-as indeed has already occun-ed 
at UA. It should therefore encourage 
flexibility in the ways institutions choose 
to develop their efforts. At the same 
time, instltutforj should be held to the 
spirit of their proposals-part cularly when 
they call for explicit budgetary commit- 
ments or when they document the way 
tiiey will use obtained results. 

o Implementation Status and Prog- 
nosis: 

All three campuses are at a relatively 
early stage of implementation. None has 
actually collected data, or even finalized 
the design of data collection instruments 
and approaches. Because of an earlier 
starting point, UA is farthest along, but 
progress has been largely organizational 
in the establishment of CRUE and the 
recruitment of staff. Overall, national 
experience indicates that all tiiree institu- 
tions are about where they should be. 
Clearly it will be another year before any 
of these effort pay concrete dividends. 
But most implementation efforts tiiat we 
have observed have taken at least three 
years to evolve-with the first year de- 
voted to planning, the second to pilot 
data collection, and the third to full-scale 
operatbns. 

At UA, tile primary accomplishment has 
been formal establishment of CRUE- 
complete with assigned staff, equipment, 
and space. While implementation was 
slowed a bit last fall, concrete plans are 
currentiy being developed for a com- 
prehensive program of longitudinal data 
collection. Beginning next fail, a group of 
some 400 new freshman will be tracked 
through tiieir undergraduate experience, 
and a range of data on this study group 
will be compiled. Simultaneously, a 
group of approximately 200 juniors will 
be studied as they move through the 



upper division. Types of data to be Incor- 
porated into ttiese longitudinal studies 
include student record data, perfor- 
mance on placement and proficiency 
examinations, persistence information, 
survey data, and data drawn from a 
series of in-depth interviews exploring 
perceptions of tiie campus environment. 
Pilot testing of the interview technique on 
a small group of graduating seniors is 
being contemplated for tills spring. 

At the same tirne, two additional ongoing 
efforts are under way at UA. First, CRUE 
staff have surveyed all departments and 
academic units to determine the kinds of 
assessment procedures and information 
already available. Results are being 
incorporated into a "database of data- 
bases" as a resource for future studies. 
Secondly, CRUE staff are beginning the 
process of identifying a number of target 
deparhnents for piloting end-of- program 
major field assessment techniques next 
yeai. Cun-ent plans are for staff to work 
with faculty in tiiese departments to help 
develop appropriate assessment instru- 
ments and to aid in interpreting results. 

Overall, we believe the prognosis for 
assessment at UA is good. Administra- 
tive support for the initiative is high, 
limited though adequate resources have 
been provided, an appropriate organiza- 
tional structure is in place, and concrete 
plans for data collection are being final- 
ized. At the same time, we have some 
concerns about information "infrastru- 
cture" and about the need for priority 
setting in CRUE's efforts in the next few 
years. There is a pressing need to coor- 
dinate a highly decentralized information 
structure if an efficient assessment pro- 
gram is to be realized. CRUE staff also 
need to have concrete "marching orders" 
about research priorities lest their limited 
resources be dissipated in a range of 
short-term efforts. We have communi- 
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cated both these concerns directly to the 
institution, and are confident that they 
will be addressed. 

ASU is currently in the process of finaliz- 
ing its assessment plan. Afaculty/admin- 
istrative committee is in place charged 
with developing the plan, and will likely 
be the vehicle for overseeing its im- 
plementation next year. At present, a 
faculty member in Educational Psychol- 
ogy has been given the temporary as- 
signment of both chairing the committee 
and of coordinating the planning effort. 
Current proposals call for a full-time 
professional to be brought on board next 
year to take over these responsibilities. 
An explicit plan for ongoing research has 
not yet been decided upon; rather the 
institution will undertake a series of ex- 
perimental data collection efforts next 
year-including pilots in general studies, 
and in a range of mayor departments. As 
noted previously, however, planning for 
assessment at ASU has been consider- 
ably hampered by the absence of a chief 
academic officer. Not only does this 
mean that firm budgetary decisions are 
difficult, but it also has caused some 
uncertainty about priorities for under- 
graduate education and the manner in 
which any instructional initiative should 
be staffed or housed. When this uncer- 
tainty is resolved, ASU should be in a 
good position to undertake a credible 
assessment effort. 

NAU is also in the final stages of prepar- 
ing a draft plan for institutional assess- 
ment. As at ASiU, planning is proceeding 
under the auspices of a faculty commit- 
tee, although unlike ASU and UA, all 
undergraduate topics are being treated 
in an integrated fashion. Primary respon- 
sibility for coordination is currently as- 
signed to the Executive Assistant to the 
President. Although permanent staffing 
arrangements are not yet certain, there 



is a clear commitment to devote neces- 
sary resources-including staffing-to 
carry out the effort. At the same time, 
there is evident, and we believe appro- 
priate, emphasis on using existing or- 
ganizational resources and committees 
to accomplish the task of assessment. 
Data collection activities proposed for the 
coming year, as at ASU, consist of a 
variety of pilot projects-some in general 
education and some in selected major 
departinents. Because of NAU lacks a 
number of basic data collection 
mechanisms such as regular student 
and alumni surveys, however, consider- 
able attention must be devoted toward 
developing and gaining experience with 
such methods in the coming year. These 
needs are fully recognized in NAU's draft 
plan. 

RECOMMENDATIONS 

Based on these observations, we offer a 
number of broad recommendations for 
consideration by the Task Force. Recog- 
nizing that the most effective assessment 
programs are mission- specific and are 
"owned" by institutions themselves, we 
first believe that the basic architecture of 
the Board of Regent's mandate is ap- 
propriate. Institutions should be required 
to establish assessment efforts within 
broad guidelines, should report how they 
have ftjnded and organized them, should 
communicate the lines of research that 
they are engaged in and how these 
inquiries are related to their instructional 
goals, and should demonstrate that they 
are using the resulting information for 
decisionmaking. 

For the most part, we believe, these 
objectives can be achieved within the 
ft'amework of existing statewide proces- 
ses and reporting requirenients. At the 
same time, we believe that some proces- 
ses and reporting requirements may 
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need to be modifierl to encourage addi- 
tional assessment practices at the cam- 
pus level. Integrating assessment activi- 
ties Into such existing mechanisms as 
the decennial review process, for exam- 
ple, has an advantage of effidency, as it 
avoids tile kinds of duplicative data- 
gathering that have proven an obstacle 
in some states. Making assessment re- 
sults a dear part of existing and ^miliar 
statewide evaluative mechanisms also 
increases the likelihood tfiat outcomes 
data will actually be used for dedsion- 
making. 

Consistent with these atguments, we 
offer the following broad recommen- 
dations: 

o Current decennial review processes 
required by the Board should include 
a more explicit outcomes component. 

Using concrete data, programs under 
review should present evidence about 

(a) the cognitive dsvelopment of stu- 
dents enrolled in the program 
against an established and articu- 
lated set of knowledge and skills 
objectives consistent with the 
program's goals and curriculum; 

(b) the success of students after 
completion of the program, with 
respect to further education and 
training, job placement and 
performance, and satisfaction with 
the program; and 

(c) the adequacy of the program as 
viewed by important external con- 
stituents including, where appro- 
priate, employers, graduate 
schools, and peers in the dis- 
cipline. Consistent with practice in 
otfier jtates, moreover, the review 
cycle should be shortened to a 



period of five to seven years. 

0 Requests for additional funding 
through "decision packages" should 
be explicitly supported, where appro- 
priate, by information drawn from the 
institution's assessment program. 

Where new initiatives are proposed, 
institutions should be required to state 
how evidence of "success" will be com- 
piled, and how tfie process of obtaining 
performance information will be made a 
part of the ongoing campus assessment 
effort. 

0 Included in the decennial review cycle 
should be a comprehensive review of 
undergraduate eaucation-with par- 
ticular emphasis on general educa- 
tion. 

Academic evaluation at both the campus 
and the system level is currently under- 
taken on a program-by-program basis. 
Nowhere is there an opportunity or a 
mechanism for evaluating undergraduate 
education as a whole-though it is 
claimed to function as such. This is 
particulariy true of the "general educa- 
tion" component of undergraduate in- 
sti-uction which, arguably, is from the 
state's perspective one of the most 
important activities that institutions en- 
gage in. Consequently, we recommend 
that a year-long multi- faceted study of 
undergraduate edu-cation be undertaken 
at the end of each complete program 
review cycle. During this year, no other 
major programs would be evaluated, 
and all attention would be devoted to 
examining the structure, functioning, and 
outcomes of the undergraduate 
curriculum as a whole. Several states 
have successfully undertaken such 
studies as part of the regular program 
review cycle in recent years-among 
them Missouri and lllinois-and these 




628 



11 



examples might be examined as models. 

0 Institutional Assessment Plans should 
clearly identify the means by which 
students are initially tested for basic 
skills (reading, writing and computa- 
tion) at appropriate levels to engage 
in college level work. 

Though not a part of college outcomes 
assessment, we found procedures for 
assessing incoming student basic skills 
to be somewhat haphazard at the three 
campuses. While we do not recommend 
adoption of a uniform, statewide basic 
skills examination such as those in place 
in Florida, Tennessee, New Jersey, or 
Texas, national experience suggests that 
all institutions should adopt basic skills 
examination programs that 

(a) test all iiicoming students using 
the same instrument (as opposed 
to allowing students to "place ouf 
of the examination by means of 
an ACT score or high school 
GPA~as sometimes occurs at 
present), 

(b) use these scores to guide a man- 
datory directed placement 
program that places students in 
appropriate remedial settings, and 

(c) requires the students so placed to 
retake the basic skills examination 
and to achieve a score equivalent 
lO students not identified as in 
need of remediation. 

0 Finally, we concur with the findings of 
other observers that the "information 
function" at both the institutional and 
Board Jevel needs attention. 

While we believe that proposed assess- 
ment initiatives at each institution, if 
properly organized and supported, will 



help tc remedy current deficiencies in 
management information, we would also 
support any additional recommendations 
that the Task Force might make regard- 
ing improvements in information and 
planning at the three institutions. At the 
same time, we concur with findings that 
the Board of Regents should reorient its 
priorities with regard to information- 
collecting to primarily information for 
statewide strategic planning rather than 
emphasizing information for account- 
ability. While a full treatment of this issue 
is beyond the scope of this report, we 
would refer the Task Force to a "White 
Paper" on accountability that we pre- 
pared for the Colorado Commission on 
Higher Education, supplied as a re- 
source to the Task Force staff. 

Overall, we find that campus-based 
efforts to assess the effectiveness of 
undergraduate education in Arizona are 
proceeding adequately. In the long term, 
however, these efforts will only be suc- 
cessful if they enjoy continuing and 
sincere support from both top admin- 
istration and faculty, and if the results of 
assessment are taken sufficiently 
seriously by the Board to visibly inform 
decisions that matter. 
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